Verschrdnkung versus Stosszahlansatz: Disappearance of the Thermodynamic 

Arrow in a High-Correlation Environment 
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The crucial role of ambient correlations in determining thermodynamic behavior is established. 
A class of entangled states of two macroscopic systems is constructed such that each component is 
in a state of thermal equilibrium at a given temperature, and when the two are allowed to interact 
heat can flow from the colder to the hotter system. A dilute gas model exhibiting this behavior is 
presented. This reversal of the thermodynamic arrow is a consequence of the entanglement between 
the two systems, a condition that is opposite to molecular chaos and shown to be unlikely in a low- 
entropy environment. By contrast, the second law is established by proving Clausius' inequality in a 
low-entropy environment. These general results strongly support the expectation, first expressed by 
Boltzmann and subsequently elaborated by others, that the second law is an emergent phenomenon 
that requires a low-entropy cosmological environment, one that can effectively function as an ideal 
information sink. 
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The status of the second law of thermodynamics and 
the emergence of macroscopic irreversibility from time- 
symmetric dynamical laws have been widely debated 
since Boltzmann's ground breaking work relating ther- 
modynamic behavior to microscopic dynamics late in the 
nineteenth century. Indeed, rarely have so many dis- 
tinguished physicists written as extensively on a subject 
while achieving so little consensus. The debate continues 
to present day. having gained intensity in recent decades 
as a surge of activity in such topics as chaos, quantum 
computing, and quantum information theory has stimu- 
lated interest in the subject [1]. 

There is nevertheless a slowly growing consensus that 
the asymmetry observed in macroscopic phenomena orig- 
inates in the "initial conditions" of our cosmic neighbor- 
hood, and ultimately that of the whole universe. Re- 
markably, Boltzmann himself arrived at the hypothe- 
sis that "the universe, considered as a mechanical sys- 
tem — or at least a very large part of it which surrounds 
us — started from a very improbable state, and is still in 
a very improbable state" as the initial condition that was 
required to explain the asymmetry in the second law [2] . 
This view has subsequently been echoed by Gold, Feyn- 
man, Lebowitz and coworkers, Peierls, Penrose, and oth- 
ers [3] , albeit with various degrees of emphasis and detail. 
In particular, Penrose has characterized the improbabil- 
ity of the initial state of the universe by the vanishing 
of the Weyl tensor in the early, homogeneous universe, 
in contrast to its preponderance in the final, clumped 
stages (which are the higher entropy states in the pres- 
ence of gravity). If so, how is the influence of a low- 
entropy, time-asymmetric cosmological environment felt 
by a thermodynamic system? "This is reflected in Boltz- 
mann's stosszahlansatz,^^ remarks Peierls [3], referring to 
Boltzmann's assumption of molecular chaos that single 
particle states are uncorrelated in a dilute gas [4]. Pre- 
sumably, one would expect the initial correlations among 



the molecules of the gas to be small in a low-entropy en- 
vironment, thus allowing subsequent interactions to raise 
their individual entropies toward equilibrium. 

Thus arises the question of whether in a high-entropy 
environment interactions can lower initially high corre- 
lations among the molecules, thereby lowering their in- 
dividual entropies and reversing the thermodynamic ar- 
row. More specifically, can the direction of heat fiow 
be reversed in an environment in which entanglement is 
more typical than molecular chaos? The primary pur- 
pose of this Letter is to show that this is indeed possible. 
In particular, we construct a class of entangled states of 
two macroscopic systems such that each individual com- 
ponent is in a state of thermal equilibrium at a given 
temperature, and when the two are allowed to interact 
heat can flow from the colder to the hotter system. An 
explicit example of this class where the two systems are 
dilute gases is also constructed. The resulting reversal 
of the thermodynamic arrow is thus a consequence of 
entanglement between the two systems. In effect, this 
entanglement disables the statistical biases that give rise 
to normal thermodynamic behavior. To analyze the op- 
posite scenario, we first establish the result that correla- 
tions are generally small in a low-entropy environment, 
a result that justifies the condition of generalized molec- 
ular chaos in a low-entropy universe. We then establish 
the second law by proving Clausius' inequality in a low- 
entropy environment. These results strongly support the 
view that the second law and the thermodynamic arrow 
are emergent phenomena that require a low-entropy envi- 
ronment, with the universe effectively functioning as an 
infinite information sink. In our cosmic neighborhood, 
this is made possible by a bright sun against a dark sky, 
thus maintaining a steady process of entropy disposal [5] . 
Needless to say, the currently favored accelerating mod- 
els of big bang cosmology nicely accommodate the role 
required of the universe. 
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As a preliminary step, we will establish the result that 
two-body correlation is on average bounded by single- 
body entropy in any collection of > 3 interacting sys- 
tems. Let the systems be labeled i = 1, 2, ... A, and the 
corresponding von Neumann entropies 5*. To quantify 
two-body correlations, we will use = S" + — S"^ , 
the quantum measure of mutual information. The basic 
tool in the derivation is the strong subadditivity prop- 
erty of entropy in the form 5' + < S''' + S^^ [6]. 
Since there are A(A — l)/2 distinct pairs in the collec- 
tion, there will be as many distinct inequalities resulting 
from strong subadditivity. When aggregated, they give 

[A(A-l)/2]-i^ \ r^<N-'Y.- 1^'- (1) 

Thus lav < Sav, indicating that a small average entropy 
guarantees a low level of two-body correlations. The sig- 
nificance of this general result is the validity of Boltz- 
mann's stosszahlansatz, for any two systems whether mi- 
croscopic or macroscopic, as a likely condition in a low- 
entropy universe. Note that we established this result 
without any reference to such problematic issues as the 
purity level of the wavcfunction of the universe. 

In much of what follows, we will rely on a fundamental 
inequality that governs the evolution of any system whose 
initial state is one of thermal equilibrium. Let the initial 
and final states of the system be pi = exp{~f3Hi)/Z and 
Pf respectively, where /3 = l/kgT. Here pi is the density 
matrix describing the initial Gibbs state, with Hi the 
initial Hamiltonian operator, Z the partition function. T 
the temperature, and ks the Boltzmann constant. Note 
that the Hamiltonian may change during the evolution, 
causing exchange of work. Thus the final Hamiltonian Hf 
will in general be different from Hi. The evolution itself 
will in general not be unitary as it may involve interaction 
with other systems, and the final state pf may not be one 
of equilibrium. 

Now consider S{pf\\pi), the relative entropy of pf with 
respect to pi , which is a non- negative quantity defined as 
—S{pf) — tr{pf log Pi). The latter property can be used 
to establish that 

SiPfWPt) = P^U -AS- /?tr(pf AH) > 0, (2) 

where AU = Uj-Ui = tr(pfHf)-tr(piHi), AS = Sf-S^, 
and S{p) = — tr(plogp) is the von Neumann entropy. 
It is important to realize that this inequality stipulates 
an initial equilibrium state and temperature only, and 
as such is fundamentally different from the standard in- 
equalities of equilibrium thermodynamics. 

Verschrdnkung versus Stosszahlansatz. Consider two 
systems A and B, each individually in thermal equilib- 
rium at temperatures and initially, which are 
placed in thermal contact and allowed to exchange heat 
but not work. In that case AH = Hf — Hi = 0, AU 
equals the absorbed heat Q, and inequality (2) reduces 



to l3Q — AS > [7] . Applying the latter to each of the 
two systems in the above process, we find P^Q"^ > AS^ 
and P^Q^ > AS^, while + ^ Q, We wiU next 
apply these inequalities to the extreme cases of zero and 
maximum initial correlations, designating them as cases 
S and V respectively. 

Case S. If the two systems are initially uncorrelated, 
as is typically expected in a low-entropy environment 
according to (1), we will have pf^ = pf ® pf and 
Sf^ = Sf + Sf. On the other hand, the final state 
will generally be correlated due to the interaction 
and we will have 5*^^^ < Sf + Sf. Since the two 
systems interact in isolation from the rest of the uni- 
verse, pf^ and will be related unitarily and we have 
S^^ = Sf^, which in conjunction with the foregoing re- 
lations leads to AS''^ + AS^ > 0. Combining the latter 
with the inequalities of the preceding paragraph, wc find 
+ P^Q^ > 0. Since Q"^ + = 0, the last in- 
equality implies that has the same sign as p^ — P^ 
or — T^, i.e., that heat fiows from the initially hotter 
system to the initially colder one. This is of course a fun- 
damental law of nature, and is seen here to follow where 
generalized Stosszahlansatz holds. In essence, the fore- 
going argument reflects Boltzmann's original reasoning: 
starting from an uncorrelated initial configuration, there 
are overwhelmingly more possibilities for final states if 
the initially colder state gains energy than vice versa. 
Model calculations using molecules as interacting ther- 
modynamic systems verify this expectation in detail [7]. 

Case V. The above scenario changes dramatically if 
the two interacting systems are significantly correlated to 
begin with, as may be expected in a high-correlation en- 
vironment [8]. To demonstrate this assertion, we will 
consider the extreme case where the two systems are 
initially entangled in a pure state while each individual 
system is in thermal equilibrium. These conditions can 
be realized for a pair of macroscopic systems whose en- 
ergy spectra, {Ef} and {Ef}, are identical except for 
a scale factor, i.e., if fJ.'^Ef = P^Ef = e^. The desired 
joint state of the two systems can then be represented as 

I^AB^ = exp(-7e,/2)|*; (3) 

where \i; A) {\i; B)) is the ith energy eigenvector for sys- 
tem A (B), 7 is a positive constant, and Z~^l'^ is a nor- 
malization constant. Note that Eq. (-■>) is essentially the 
Schmidt decomposition of jfi'^^). It can now be read- 
ily verified that the individual states of the two systems 
(obtained from p^^ by tracing over the Hilbert space of 
the other) are thermal equilibrium states at temperatures 
given by P^ = and P^ = /i^7. 

Just as in case S, we consider a process of heat ex- 
change between A and B and find P^Q^ > AS^, 
P^QB > AS*^, and Q"^ + = 0. However, in contrast 
to case S, the joint state of the two systems is pure in 
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this case, so that p and p are now isospectral with the 
consequence that = at all times and AS'"^ = /S.S^ 
for the process. Since in general Q^Q^ < 0, the above 
inequalities imply that AS^ = AS^ < 0, thus reversing 
the inequality we found for AS^ + AS^ in case S. This 
reversal in turn leads to /3^Q^ + p^Q^ > AS^ + A5^, 
which allows both directions of heat flow, including that 
from the initially colder body to the hotter one. Note 
that equality in this result obtains only if there is zero 
heat exchange between the systems (in violation of the ze- 
roth law since initial temperatures are unrestricted here) . 
We will later present a model exhibiting this reversal ex- 
plicitly. 

What is the cause of this bizarre behavior? The clue 
is in the dual character of while entanglement 

forces the individual entropies and to move in 
lock-step, the maximal entropy of the initial equilibrium 
states implies that the individual entropies can only de- 
crease. Therefore, there is no opportunity for any sta- 
tistical dominance of one direction of heat flow over the 
other, in stark contrast to case S. This feature is strik- 
ingly apparent in the model calculation considered later. 
The main lesson to be drawn here is that the statistical 
biases that cause normal thermodynamic behavior can 
be neutralized by pre-existing correlations between the 
interacting systems. Thus a low-entropy environment, 
which serves to guarantee low correlations and preclude 
the anomalous behavior just described, is indeed a pre- 
requisite for normal thermodynamic behavior. 

To further highlight the contrast between the two cases 
considered above, we will now establish the second law 
in case S by proving Clausius' Theorem in a low-entropy 
environment. Consider a macroscopic system that un- 
dergoes a cyclic evolution in thermal contact with a sc- 
ries of heat reservoirs, absorbing from the reservoir 
at temperature Tj^ while exchanging work as a result of 
possible changes in its Hamiltonian (e.g., because of ex- 
pansion). Note that by definition the work exchange is 
associated with a unitary evolution and docs not entail 
information transfer, in contrast to the heat exchange 
with the reservoir. Note also that Tj is the temperature 
of the jth reservoir, as there's no presumption of thermal 
equilibrium with the system here. 

Consider the jth process, starting with the uncorre- 
lated system-reservoir state Pjpf, where pj^ is a Gibbs 
state at temperature TJ^ and pj is arbitrary, and cul- 
minating in the correlated state Pj^ ■ The Hamiltonian 
operator governing this evolution may be represented as 
+ Vf + Hf + Hf^, where Hf and Hf refer to the 
system and reservoir, H^^ to their interaction, and 
to the interaction of the system with the external agents 
with which it is exchanging work. Just as in case S above, 
we find + ASf > 0, Vf notwithstanding, and ap- 
plying inequality (2) to the reservoir, we conclude that 
f3f Qf > ASf, where /3f = 1/kTf refers to the initial 



temperature of the reservoir. Furthermore, the energy 
exchange between the system and the reservoir is subject 
to = —Qj, since the work exchange does not involve 
the reservoir. Combining the last two inequalities, we 
find Pj^Qj + ASj < 0. Remarkably, the system obeys 
this inequality without necessarily having a well-defined 
temperature (/3j^ refers to the reservoir) and regardless 
of possible changes in its Hamiltonian. 

If the last inequality is summed over the cycle, the 
entropy changes add up to zero, since the final state of 
the system is the same as the initial one, and we find 

E/.^?f<0' (4) 

which is Clausius' inequality. 

Next we will construct a dilute-gas model for case V 
that will exhibit heat flow from the colder to the hotter 
system. The dilute nature of the two gases allows us to 
simplify the calculation by focusing attention on single 
particle interactions. We therefore consider particle a of 
one gas interacting with particle b of the other in a vol- 
ume V. The initial, joint state of the two is pure and 
entangled, but in such a way that their individual states 
are in thermal equilibrium at different temperatures. To 
exhibit the structure of this state, we let |a, aak) repre- 
sent a state of momentum for particle a and |6, a^k) 
a state of momentum a^k for particle 6, where aa and 
at are positive parameters. The joint state of the two 
particles is then 

k"") = Z-'^^y^, exp(-7kV4m) |a, a^k) |5, a^k) , (5) 

where Z and 7 are as defined in Eq. (o), m is a mass 
scale, and we have set h= 1. 

It is useful at this point to continue the calculation 
using the configuration representation in the infinite- 
volume limit. Then Eq. ("1) appears as 

t^°''(r°,r'') = [VZ{2TTff^ Jd^kexp{-jk'^/4m) 

X exp(iQ;ak • r°) exp(iQ;f,k • r''). (6) 

The individual (or marginal) states of the two systems 
can now be found as 

p''(r,r') = [Z{2'n:aaabff^ J d^kcxp{--fk'^/2mal) 

X exp[ik • (r — r')], (7) 

and an analogous expression for p''. Note that 
7k^/2ma^ = /3°k^/2TO", which identifies p° as a Gibbs 
state at temperature = (^s/?")""'^ = ma'l/jkBm"', 
and similarly for p'^ with T** = mal/jkB'm!', where m° 
and m'' are the respective masses. Thus each system, if 
experimented upon in isolation from the other, will be 
found to be in thermal equilibrium at the specified tem- 
perature. However, if the two systems are allowed to 
interact, it is the pure state given in Eq. ('•) that must 
be considered as their initial state. 
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To model a thermal interaction between the two sys- 
tems, we consider an adiabatic switching of the interac- 
tion so that the initial and final states are non-interacting 
and the interaction of the two with external systems is 
made negligible. Such an interaction amounts to a col- 
lision, with a;"''(r",r*) representing the non- interacting 
incoming state. Therefore, the fully interacting state of 
the two-body system can be represented as 

<ft(r^r'') = [\/Z(2^)T'/^^fccxp(-7kV4m) 

xV+(r^r''), (8) 

where ^j^(r°, r'') is the "in" state that corresponds to the 
non-interacting state exp(iaak • r") exp(iQ;&k • r''). Note 
that the initial momenta of the particles in each term of 
the coherent superposition tof^f{r'^ , r'') are collinear and 
proportional in magnitude, reflecting the entangled na- 
ture of this state. It is important to realize that there 
would be no such correlation between the initial momenta 
of the particles otherwise. For example, the uncorrelated 
initial state p"" ® which would be typical in a low- 
entropy environment and exhibit normal thermodynamic 
behavior as shown above for case S, entails particle pairs 
of uncorrelated momenta. 

The correlation between the initial momenta of the col- 
liding particles in a;f^((r", r**) makes it possible to de- 
termine the direction of energy flow from conservation 
laws. For a collision event that starts with momenta 
Qiak and a^k, we find that the fractional kinetic energy 
gain for particle a as a result of the collision is given by 
4x(x - l)sin^(0/2), where x = [m°- /{m"- -I- m!')][{aa + 
ab)/Q!a], and 6 is the scattering angle in the center-of- 
mass system. Thus for all but forward scattering, particle 
a gains energy if a; > 1. This condition can be satisfied 
if inf' /rn}'){T^ /T°-) > 1, where we have eliminated Ua.b 
in favor of the initial temperatures. Clearly, if m" > m'', 
particle a can gain energy even if T" > T^, thus reversing 
the normal direction of heat flow. Note that the direction 
of energy flow would then be the same for every term in 
the wave packet of Eq. (8) , clearly indicating that ther- 
mal statistics play no role in this result. This is the main 
lesson of this example, to wit, that entanglement is ca- 
pable of destroying normal thermodynamic behavior by 
defeating the statistical biases that underlie it, instead 
rendering such macroscopic outcomes as the direction of 
heat flow dependent on microscopic details. 

We close this Letter with a few concluding remarks. 
First, we have focused on the two extremes of ambient 
correlations, cases S and V, primarily to underscore the 
contrast in their resulting thermodynamic behavior. To 
be sure, these extreme cases are idealizations. However, 
they do serve to characterize likely thermodynamic be- 
havior under the specified conditions of ambient corre- 
lations. Second, while we have used the von Neumann 



entropy extensively in our calculations, the main results 
of our analysis concern energy flow and are not com- 
mitted to any specific interpretation of that quantity for 
non-equilibrium states. Rather, the primary role of the 
entropy function in our analysis is as a measure of in- 
formation, which is inextricably intertwined with energy 
flow in thermodynamic interactions. Third, it may be 
noted that the results presented here apply to the ther- 
modynamics of microscopic systems as well. However, 
the two regimes are distinguished by the magnitude of 
fluctuations, which are comparable to averages for micro- 
scopic systems and normally negligible for macroscopic 
systems. Finally, it is important to note the importance 
of using the quantum description where entanglement ef- 
fects play an essential role. Thus we have avoided clas- 
sical phase space methods as inadvisable in the present 
context, although it may be possible to formulate some 
of the arguments presented here in classical terms. 



* Electronic address: hpartovi@csus.edu 

[1] The literature on this subject can be traced through J. 
L. Lebowitz, Rev. Mod. Phys. 71, S346 (1999), and A. 
Wehrl, ibid. 50, 221 (1978); see also Quantum Limits to 
the Second Law, ed. D. P. Sheehan (AIP Conf. Proc. 643, 
2002). Diversity of view, on the other hand, is evident in 
pubhshed letters, Phys. Today 47, 11 (1994), written in 
reaction to J. L. Lebowitz, ibid. 46, 32 (1993), as well as 
in J. Bricmont, Ann. (N.Y.) Acad. Sci. 79, 131 (1996). 

[2] L. Boltzmann, Ann. Phys. (Leipzig) 60, 392 (1897); Eng. 
tranl. in S. G. Brush, Kinetic Theory, vol. 2 (Pergamon, 
Oxford, 1966), p. 238. 

[3] T. Gold, Am. J. Phys. 30, 403 (1962); R. Feynman, The 
haracter of Physical Law (British Broadcasting Corpora- 
tion, 1965), p. 116; R. Peierls, Phys. Today 47, 115 (1994); 
R. Penrose, The Emperor's New Mind (Oxford University 
Press, New York, 1989), p. 339. In particular, Lebowitz 
and coworkers [1] have forcefully advocated this point of 
view in their writings. 

[4] L. Boltzmann, Sitzungsberichte Akad. Wiss. (Vienna) 66, 
275 (1872); Eng. tranl. in S. G. Brush, Kmetic Theory, 
vol. 2 (Pergamon, Oxford, 1966), p. 88. 

[5] L. Boltzmann, as quoted in E. Broda, Ludwig Boltz- 
mann, Man-Physicist-Philosopher (Ox Bow, Woodbridge, 
CT, 1973), p. 79. See also E. Schrodinger, What is Life? 
with Mind and Matter (Cambridge University Press, Cam- 
bridge, 1967), as well as Gold and Penrose [3]. 

[6] Strong subadditivity was conjectured by Lanford and 
Robinson and proved by Lieb and Ruskai; see M. B. 
Ruskai, J. Math. Phys. 43, 4358 (2002) for original and 
recent references. 

[7] M. H. Partovi, "Quantum Thermodynamics," Phys. Let- 
ters A137, 440 (1989). 

[8] It is worth noting here that macroscopic entanglement has 
already been realized: B. Julsgaard, A. Kozhekin, and E. 
S. Polzik, Nature 413, 400 2001, reportrd entangling some 
10^^ cesium atoms for about half a millisecond. 



